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ABSTRACT 



A multiple frequency quaternary phased shift keyed (MFQPSK) signaling system 
has been developed and experimentally tested in a controlled environment. In order to 
insure that the quality of the received signal is such that information recovery is possible, 
error detection correction (EDC) must be used. This thesis reviews various EDC coding 
schemes available and analyzes the"ir application to the MFQPSK signal system. 
Flamming. Golay, Bose-Chaudhuri-Hocquenghem (BCH), Reed-Solomon (R-S) block 
codes as well as convolutional codes are presented and analyzed in the context of specific 
MFQPSK system parameters. A computer program was developed in order to compute 
bit error probabilities as a function of signal-to-noise ratio. Results demonstrate that 
various EDC schemes are suitable for the MFQPSK signal structure, and that significant 
performance improvements are possible with the use of certain error correction codes. 
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I. INTRODUCTION 



A. CONCEPT OF OPERATIONS 

Modulation is the process by which signals are transformed into waveforms tailored 
to the characteristics of the transmission channel. The medium for the data transmission 
may be free space, a wire, an optical fiber or underwater acoustics, each possibly re- 
quiring a different modulation technique. It is not desireable to have to design com- 
munications links around the type of modulation dictated by the propogation medium. 
A single modulation technique that is flexible, can be used for analog and digital signals, 
is not channel restrictive, and can emulate existing modulation techniques would be 
ideal. 

Multi-Frequency Modulation (MFM) [Ref. 1] is a technique that embodies some 
of the above characteristics. Developed at the Naval Postgraduate School, MFM was 
designed for computer-to-computer communication links and information exchange 
networks. Applications of MFM to Navy satellite communication, ship-to-ship shore 
communication and acoustic communication are being considered. MFM systems op- 
erating at audio frequencies are particularly suited to acoustic communications. Con- 
current research with Naval Ocean Systems Center (NOSC), San Diego is ongoing in 
this area. More specifically, a Multi-Frequency Quaternary Phased Shift Keyed 
(MFQPSK) signaling system is being built and tested by NOSC with Naval Postgraduate 
School assistance. 

B. PREVIOUS RESEARCH 

The MFQPSK signaling system is well suited for high data rate acoustic communi- 
cations [Ref. 2). Research in MFQPSK signaling systems at the Naval Postgraduate 
School is currently in progress. However, past efforts in this area of research have pri- 
marily focused on the generation of the signal itself through Fast Fourier Transform 
techniques. Limited attention has been given to the quality of the received signal. That 
is, error detection correction (EDC) has played a minor role in signal development to 
date. During an initial feasibility study, a single error correction, double error detection 
radix-5 Hamming code was proposed [Ref. 3]. However, since this initial proposal, EDC 
coding has been generally neglected, although it is seen as a necessary tool for the suc- 
cessful use of MFQPSK. 
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C. OVERVIEW 

The purpose of this study is to explore various coding schemes and evaluate their 
effectiveness when used in conjunction with MFQPSK signaling. Three coding schemes 
in particular (BCH, Reed-Solomon and convolutional) are singled out and explored in 
depth. An algorithm was developed to evaluate the performance of these codes and their 
application to this project. Chapter Two describes the MFQPSK signal, so as to provide 
a brief conceptual understanding of the signal without going into the in-depth explana- 
tion that can be found in References 1 and 4. In Chapter Three, derivation of the basic 
probability equations and explanation of some of the channel variables that affect signal 
transmission are presented. Chapter Four presents a detailed discussion of various 
coding schemes and their associated bit error performance. Some schemes (such as 
Hamming and Golay codes) are presented for completeness in describing the funda- 
mentals of coding theory but are not analyzed in depth in so far as their application to 
MFQPSK signaling. Chapter Five is devoted to the application of error performance 
characteristics of various coding schemes to the MFQPSK signaling system. Chapter 6 
concludes this study by singling out a particular coding scheme that is well-suited for the 
MFQPSK signaling and suggesting areas of further research. 
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II. THE MFQPSK SIGNAL 



The specific design parameters of the MFQPSK signal used in this research project 
are not necessarily design constraints on the EDC coding scheme. However, they are 
included here in order to provide the reader with a better understanding of the MFQPSK 
signal and the overall MFQPSK communication system operation. By modulating fre- 
quencies with phase information and using frequency to time domain transformations 
via the Fast Fourier Transform (FFT), the MFQPSK transmission signal can be gener- 
ated. 

Figure 1 shows the basic structure of the MFQPSK signal. 
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Figure 1. The Structure of the MFQPSK Signal 

Frequency is plotted on the vertical axis depicting M tones, Af Hz apart. Time is plot- 
ted on the horizontal axis showing N bauds each of length AT seconds. The symbols, 
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{< />„ ) represent the phase of the j' h tone in the baud. In quadrature phase 



In the MFQPSK signaling system, the {</>,,} components represent unique 
time frequency phases. These components and their complex conjugate at the image 
frequencies are loaded into a two dimensional array that is used as an input to an In- 
verse Fast Fourier Transform (IFFT). The image frequency components are needed to 
insure that the corresponding time domain signal is entirely real. Thus, the IFFT gen- 
erates a collection of real, time domain signal sequences that are time samples of the 
analog transmit signal. Processing these through a D/A converter completes the gener- 
ation of the i’ h baud. The total signal packet is completed by an A 7 -fold repetition of this 
frequency-to-time domain transformation. 

A complete data packet, P, is made up of M tones in N bauds. (It is not necessary 
that all of the frequency bins contain data information. The j th tone could be used for 
synchronization for example.) Since one of four phases is determined by a di-bit (a se- 
quence of two binary bits) there will be 2NM bits in each packet. The tone spacing is 
the inverse of the baud length. By increasing baud lengths, more tones are used and 
vice-versa. 

Demodulation of the MFQPSK signal is accomplished by a process that is just the 
opposite of the method of generation. The time domain signal is filtered, sampled and 
converted to a digital format through an A, D converter. This sequence is partitioned 
into .V sequences corresponding to the N bauds and loaded into a complex valued array 
with imaginary parts set to zero. This array becomes the input to an FFT which gen- 
erates a complex valued array containing the phases of the original transmitted baud. 
Computing this .Y-fold times, will generate the total transmitted data packet. 

This brief explanation is provided for conceptual purposes only and intentionally 
does not address the problems of synchronization, channel noise, multipath propagation 
and non-linear characteristics of the supporting equipment. Individually, these are sub- 
jects of various research projects currently associated with the MFQPSK signaling sys- 
tem. 
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III. CHANNEL/CODING CONSIDERATIONS 



A. CHANNEL CONSIDERATIONS 

The acoustic properties of the ocean constrain the MFQPSK signal in this applica- 
tion in various ways. For instance, since short signal wavelengths are absorbed more 
readily than longer wavelengths, the signal transmission bandwidth is limited by the de- 
sired maximum range of communications. This will, in turn, constrain the maximum 
rate at which data can be transmitted. Another channel consideration concerns the 
multipath characteristics of acoustic propagation. Surface and sea bottom reflections 
as well as sound channels may cause the signal to propagate through various paths with 
different delays. Doppler shift due to the movement of the source and the random dy- 
namics of the sound velocity pose additional problems. 

Acoustic channel modeling for the MFQPSK signaling system is a separate project 
being explored at the Naval Postgraduate School. Its purpose is to identify and model 
important the variables of acoustic signal transmission. Also included in the model are 
the symbol energy-to-noise spectral density ratio EJN 0 , the bandwidth and data rate. 
(Since EJX C is actually a signal-to-noise ratio it will be referred to simply as SNR 
throughout this work.) Once complete, coding gains can be computed based on this 
model as a function of SNR, baud length, doppler mismatch, etc. 

B. CODING CONSIDERATIONS 

In this signaling system, the purpose is to transmit digital information at the maxi- 
mum possible rate with a fixed signal power while maintaining adequate error perform- 
ance. Varying definitions of adequate error performance has led to the specification of 
many EDC coding schemes, each exploiting some feature of the transmitter-channel- 
receiver trilogy. If the medium introduces high-level constant noise, increasing trans- 
mitted power may be the only means to compensate for the noise and ensure adequate 
receiver performance. Perhaps full replication of the transmitted signal is not needed 
on the receiving end. In this case, a lower transmitter power may be used and the 
transmitted signal extrapolated from what is received. Additional signal degradation 
from such variables as mulitpath propagation, fading, and doppler shift further reduce 
the received SNR and or create decoding errors and amplify the need for error detection 
and correction. 
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The MFQPSK signal is to be encoded from a binary data stream. Figure 2 shows 
the block structure of a binary data stream, how it is partitioned into information and 
parity bits and illustrates the meaning of a di-bit. 



info bits parity bits 
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dibit 



Figure 2. Block Coding of a Binary Data Stream 



Due to the randomness of phase assignments, it may be assumed that any incorrect de- 
cisions of the receiver will have equal probabilities. 

In light of the channel considerations previously discussed, a coding scheme must 
be identified which will provide adequate error performance. However, since all these 
studies are not yet complete, all performance graphs in this thesis will be plotted showing 
probability of error as a function of SNR. 

1. Probability Development 

In this study, two error probabilities will be continually compared. The first 
will be that of a MFQPSK signal which is not EDC coded. In this case, bit error 
probabilities will be dependent on the type of demodulation used. Secondly, EDC coded 
received signal error performance for particular coding schemes will be developed and 
compared to each other in order to evaluate which coding schemes may be most suitable 
for an MFQPSK signaling system. 

a. Uncoded transmission 

In determining the probability of error for an uncoded bit stream, the pri- 
mary consideration is the modulation type. Since there is no coding involved, this will 
specify the performance of the signaling system. Figure 3 illustrates a QPSK signaling 
constellation developed from Reference 5 . 



6 




Figure 3. QPSK Signal Constellation Diagram 



Receiving two bits of information, left bit and right bit ( L b and R b , respec- 
tively), the probability that the left bit was received correctly (L t C) in additive white 
Gaussian noise given that signal s c was transmitted is: 



Pr{L b Cls 0 ) = Pr{L b C\s x ) = 1 -Q 




(3.1) 



= Pr{L b C) (3. In) 

The function Q(x) is the complementary error function or co-error function and is de- 
fined as: 







(3.2) 



Equation (3.1a) now represents the unconditional probability that L b is correct. This is 
irrespective of what signal was transmitted. Similarly, the unconditional probability that 
R b is correct is identical. Thus, 
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Pr{bil correct } ■= 1 — Q 



(3-3) 




Therefore, the bit error probability is 

p = Pr{bit incorrect } = 1 — Pr{bit correct } = Q 

A graph of p as a function of EJN,, denoted SNR, is shown in Figure 4. 




(3.4) 




Figure 4. Bit Error Probability for Uncoded QPSK Signals 



8 



b. Received EDC coded transmission 

When a bit stream is transmitted over a noisy channel, errors will occur 
causing the transmitted and received bit streams to differ. Given that a specific bit was 
transmitted, the probability that it is received in error is p, and the probability that it is 
correctly received is (1 - p). Given a message consisting of a string of n bits, the proba- 
bility of no error in all n bits is the individual correct probabilities raised to the number 
of n bits, namely, 

(1 -P) n (3-5) 



and the probability of a single error in the n bits is: 



np{\ - p) n 1 



Similarly, the probability of exactly two errors in the n bits is: 



n{n — 1 ) 
2 ! 



/> 2 U ~P) 



(3.6) 



(3.7) 



Equations (3.6) and (3.7) represent exact values for probability of error. This is for the 
case that exactly n or fewer errors are detected and corrected. Codes that do this are 
called perfect codes. As will be explained in Chapter 4, there are very few perfect codes: 
the Hamming (r = 1), the Golay (/ = 3) and a ternary Golav code are examples. Other 
/-error correcting codes can correct all occurrences of / errors and varying percentages 
of more than / errors. When computing P B for non-perfect codes, it is understood that 
the code is capable of correcting all occurrances ofy < / errors. However, more that / 
errors can occur, that is j = / + 1, resulting in decoded errors. Therefore, by summing 
the total probability of j errors in the n positions and dividing by the number of bits leads 
an upper bound on P B . the probability of bit error of /-error correcting codes: 




(i -pT~ j 



where p = Q[JSNR ). A plot of equation (3.9) appears as Figure 5. 



(3.8) 
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Figure 5. General Bit Error Probability for Coded Signals 
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IV. ERROR DETECTION/CORRECTION CODES 



A. FUNDAMENTAL CONCEPTS 

Error detection correction (EDC) coding provides error control in digital informa- 
tion transmission. An encoder adds redundancy to a transmitted message in such a 
manner that, upon decoding, the correct digital information, even in the presence of 
channel-induced errors, can be determined. Redundancy is added in such a way that the 
decoder decisions can be based on several received bits rather than on one, as in uncoded 
systems. 

Error control can be accomplished using forward error correction (FEC), automatic 
repeat request (ARQ), or a variety of hybrid FEC-ARQ approaches. Using FEC, the 
decoder corrects as many channel errors as possible. This is done by generating an es- 
timate of the transmitted sequence within the limitations of the code. Using ARQ, the 
decoder detects errors and prompts the transmitter to retransmit as required. Because 
of the duplex nature of the ARQ procedure, it was not considered viable for this project. 
Therfore FEC coding only is being considered here. 

FEC codes can be classified in two general categories, block and convolutional. 

1. Block Codes 

Block codes process data in blocks that are independent from each other. The 
encoder transforms a block of k message bits into a block of n binary coded bits, where 
n> k. The ratio of k/n is called the code rate R, where 0 < R < 1. Block codes are 
expressed in terms of/7 and k such as a (n, k) code. A block code represents a one-to-one 
transformation where 2* information /c-tuples are uniquely mapped into a set of 2* 
codeword / 2 -tuples. 

A wide variety of linear block codes exist. The ones that will be considered here 
as they may apply to this project include: the Flamming, Golav, Bose-Chaudhuri- 
Hocquenghem (BCH), and Reed-Solomon (R-S) codes. 

2. Convolutional Codes. 

Convolutional codes provide n output coded bits for each group of k input bits. 
However any /7-coded bit convolutional encoder output depends not only on the last set 
of k input bits but also on several preceeding sets of input bits. Convolutional encoders 
are described by n, k and K. The code rate, R, is defined by k/n , and K, known as the 
constraint length, is the number of stages in the shift register used. Shift registers are 
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used to process the bit stream. As a bit is fed into the shift register, that particular block 
of bits in the shift register are modulo-2 added in a predetermined manner, described by 
so-called generating polynomials, and the encoded bit stream output is taken from the 
modulo-2 adders. The next bit is then fed into the shift register causing all previous bits 
to shift one stage and the output is again taken from the modulo-2 adders. This process 
is repeated until all the information bits are processed through the shift register. 
Convolutional codes are expressed either as («, k, K) or (R, K). As an example, a 
(1/2, 3) convolutional encoder is shown in Figure 6. 



Input bit 
m 




Figure 6. Convolutional Encoder: (Rate = 1/2, K = 3, reproduced from page 

319 of Reference [6]) 

B. HAMMING CODES 

Hamming codes are a class of block codes used for error detection and/or correction 
applications. They are also members of a group of codes called perfect codes, A perfect 
code is one in which all the vectors described by the code are contained within a sphere 
of radius i = [(*/„,,„ — 1)/2] about the codewords. Here t represents the number of errors 
the code can correct and d mn is the minimum distance between codewords of the code. 
Minimum distance is an integral part of determining the error correcting capability of 
block codes. To define d min , consider the following: if u and v are two vectors of a code 
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then, by definition, u © v must also be a code vector where code vectors represent a bit 
sequence of length n and © indicates modulo-2 addition. The Hamming distance be- 
tween any two code vectors is equal to the number of places where the two code vectors 
disagree. This corresponds to the weight (i.e., number of l's) of u © v. Thuis d min is the 
minimum weight of all non-zero code vectors. A Hamming code has ( n = 2 m -l, k = 
2 m *1 -m, d mm = 3). Therefore, one can see the (7, 4) Hamming code has a minimum 
weight of d min = 3 and therefore, has a single error correcting capability. The binary 7 
Hamming (7, 4) code is also perfect since 2 3 (the number of vectors in a sphere of radius 
1 about a codeword) times 2 4 (number of codewords) equals T, the total number of 
vectors [Ref. 7]. 

Hamming codes are developed around some basic principles: 

• All noise is modeled as channel noise. 

• The channel is a binary symmetric channel. 

• In all computations, modulo base must equal radix base (in most cases this will be 
modulo 2). 

• Hard decision decoding is used.l 

Parity check matrix and syndrome development are necessary when evaluating block 
codes. The parity check matrix H consists of all nonzero w-tuples as its columns, ar- 
ranged in the following form: 



H = [I Q] 



(4.1) 



where I is an in x m identity matrix and the submatrix Q consists of 2 m -m-l columns 
which are m-tuples of weight 2 or more. As an example, with m = 3, 



H = 



10 0 0 111 
0 10 10 11 
0 0 1110 1 



(4.2) 



The coded vector c of a Hamming code is constructed from binary representations 
of position locations. All odd numbered positions end with a 1 when represented in bi- 
nary form. Therefore, a parity check is used to cover the odd positions 1, 3, 5, 7, .... 
Similarly, the second parity check covers positions 2, 3, 6,1, 10, 11 all these positions 



1 Hard decisions refer to the cases in which no confidence associated with the bit decision is 
known. 
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have a 1 in the second-lowest position in its binary form. The third parity check will 
cover positions 4, 5, 6, 7, 12, 13, 14, 15, .... 

If the information to be transmitted contains four bits, say [10 10], the coded vector 
will be constructed as [- - 1 - 0 1 0] where the (-) are used as parity checks. The total 
number of odd positions l's are modulo-2 added and the result entered in the first posi- 
tion. Now c = [1-1-010]. Next, the second parity check is entered in position two 
as the modulo-2 sum of the digits in positions 2, 3, 6, and 7. The coded vector is now 
[10 1-010]. Finally, by modulo-2 adding the l's in positions 4, 5, 6, and 7 the third 
parity check is accomplished and c is completed as [1 0 1 10 10]. 

Given a coded transmitted vector c, where c is the coded bit stream of information 
bits and error correction coding, and a received vector r, Reference [8] defines the syn- 
drome as S = rH . The syndrome will be used to locate error positions. If no trans- 
mission errors occur then, since Hc r = 0, Hr 7 = 0 because r = c . 

To continue the above example, let c = r = [10 110 10]. This is the desired 

coded transmission and contains no errors. Therefore, the syndrome 



S = Hr = 0 



1 0 0 0 1 1 1 
S= 0101011 
0 0 1110 1 



1 

0 

1 

1 

0 

1 

0 



= 0 



(4.3) 



If a single error were introduced, the received vector would be: r = (c + e) where c re- 
presents the transmitted vector and e represents an introduced error. Computing the S 
vector, S = He 7 + He 7 and knowing that Hc 7 = 0 , S = He 7 . The syndrome depends on 
the error vector and not on the codeword sent. The syndrome is a vector which repres- 
ents the column where the errors occur. 

Now using the previous example, let the transmitted vector be 



c = [101 1010] 



(4.4) 



and let e = [ 0 0 0 1 0 0 0 ], so that r = [1010010]. 
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Since 



H c T + H e T = S 



and 



Hc r = 0, 



then, 



1 

0 





1000111“ 




1 




"o' 


s = 


0 10 10 11 




0 


= 


1 




0 0 1 1 10 1 




0 




1 



1 

0 



(4.5) 



Comparing the syndrome to the H matrix shows that entries in the fourth column 
of H are identical to the syndrome thus indicating an error in the fourth position of the 
received vector. By inverting the digit in this position, a correction to the received vector 
is accomplished. 

Hamming codes can easily be extended to double error detection single error cor- 
rection codes by adding a parity check as the top row of the matrix. For example, the 
H matrix of Equation (4.2) results in 



11111111 
10 0 0 1 1 1 0 

H = (4.6) 

0 10 10 110 

0 0 1110 10 

The usefulness of this extension is limited as the extended Hamming code can only detect 
the existence of a double error, and still only correct single errors. 

Hamming codes were developed for self-checking of the Model 5 Relay Computers 
built by Bell Telephone Laboratories in the late 1940's [Ref. 8]. Because of computer 
infancy at the time of the code's creation, Hamming codes are relatively simple and of 
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limited capabilities by today's standards. However, they serve as the cornerstone of 
EDC coding and are described in this report for completeness. 

The initial feasibility study of the MFQPSK signal included a radix-5 Hamming code 
for each of the frequency bins [Ref. 3]. Using modulo-5 algebra and a two-dimensional 
matrix, the radix-5 code proved useful. However, as with all Hamming codes, it was 
only capable of single error correction. 

C. GOLAY CODES 

The next extension of the Hamming code is the Golay code. Like the Hamming 
code, the (23, 12) Golay code is also a perfect code. In fact, the Hamming and Golay 
codes are the only known binary perfect codes.2 Because the code rate (k/n — 12/23), is 
awkard to work with, a parity bit is added creating an extended (24, 12) Golay code. 
This added parity bit increases d min from 7 to 8. Both Golay codes possess triple error 
correcting capabilities. The extended Golay code is more powerful than the Hamming 
codes but also carries drawbacks: a more complicated decoder, a lower code rate and, 
with it, greater bandwidth expansion. 

Although Golay codes' error performances are superior to Hamming codes, from a 
practical point of view, Golay codes are limited by their short block lengths and have 
limited practical application when considering the availability of other more powerful 
codes. The Golay code's uniqueness as a perfect code (or quasi-perfect for the extended 
Golay code) carries with it many mathematical properties which are used in coding the- 
ory to group theory and other, more esoteric, mathematical topics. 

D. BCH CODES 

Of the many classes and subclasses of random error-correcting codes proposed to 
date, the class discovered by Ilocquenghem in 1959 and independently by Bose and 
Chaudhuri in 1960 is the most extensive and powerful one. The Bose-Chaudhuri- 
Hocquenghem (BCH) codes are a generalization of the Hamming codes but allow 
multiple-error correction, while providing a large selection of block lengths, code rates, 
and error correcting capability. Because of this flexibility, there are many BCH code 
implementation algorithms. At block lengths of a few hundred, the BCH codes outper- 
form many other block codes with similar block length and code rate [Ref. 6[. 

For any positive integer m and t ( t < 2 m ~'), there exists a BCH code with the fol- 
lowing parameters: 

2 There is a perfect ternary (11, 6) Golay code but it will not be discussed in this research. 
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Block length: n = 2 m -1 

Number of parity-check digits: n - k < ml 

Minimum distance: d mn >2t+\ 

This code is capable of correcting any combination of / or fewer errors in a block 
of n = 2 m -1 digits. 

The alphabet of a BCH code for n = (2 m — 1) may be represented by the elements 
of the appropriate Galois Field, GF(2 m ), whose primitive element is a. The generator 
polynomial, g( • ) of the /-correcting BCH code is given by the least common multiple 
(LCM) of A/, (A'), M 2 (X ), ..., \l 2l {X). That is, 



g(A) = LCA/[A/,(A'), M 2 (X), ..., A/ 2 ,(A)] (4.7) 

where A/,( X) is the minimum polynomial of of a', i = 1,2, ..., 2/, each unique to 
GF{ 2"’) .3 Since the minimum polynomials for a 2 . a J , ..., a 2 ' (all even powers of a ) are the 
same as those of a, a 2 , a 5 , . . . , the generator polynomial is reduced to: 

U(X) = TC.U[A/,(A’), -V/ 3 (A’), A/ 2 ,_,(A')3 (4.8) 

Values for M,(X) are tabulated in texts and technical reports based on values of m for 
specific GF(2 m ). 

Consider a (15. 7) double-error correcting BCH binary code for which m = 4. The 
generating polynomial is: 



g(A”) = LCM[M\{X), A/ 3 (A')] 



(4.9) 



= -V/ 1 (A')A/ 3 (A') 

= (1 + X + A J )(1 + X + A' 2 + A' 3 + X A ) 

= 1 + X 4 + X* + X 1 + X 8 (4.9 a) 



Similarly, for a (15, 5) triple-error correcting BCH binary code over GF(2 4 ), the gener- 
ating polynomial is: 



g(A0 = LCA/[A/j(A), M 3 (X), A/ 5 (A1] (4. 10) 



3 The minimum polynomial over GJ ( 2 m ) of is the lowest degree monic polynomial A/(/S) 

with coefficients from Gf( 2'”) such that M{fl) = 0. 
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= M x {X)\UX)M s {X) 

= (1 + X+ ^)(1 + A'+ X 2 + X 3 + >Y 4 )(1 + X+X 2 ) 

= 1 + A'+A^T A^ + X* + A' 5 + A^ + AT 10 (4.10a) 

1. Use of Generator Polynomials 

Generator polynomials are used in the formulation of a generator matrix, G, 
where G = [I* P] and a parity check matrix H, where H = CU P 7 ]- A code vector 
c, is obtained by multiplying the message vector m and the generator matrix G, namely 

c = mG (4.11) 

The received vector r will consist of: 

r = c + e (4.12) 

(If there are no errors, e = 0.) Obtain the syndrome S, 

S = rH r =eH r (4.13) 

Then by inverting the digits at the locations specified by the syndrome, the decoded 
vector d is obtained, where d corresponds to c so long as there are t or fewer errors. 

2. Decoding BCH Codes 

Chapter 6 of Reference [9] presents a detailed discussion of decoding BCH 
codes. The highlights of that discussion are presented here. Consider a received vector 
r = c(X) + e (X) as before. Since g(X) is a factor in c(X) and ot, a 2 , ..., a 2 ' are the roots 
of g(X) then, 

r(cc') = c(a ( ) + e(a') (4.14) 

= e(a') / = 1, 2, ...2t (4.14a) 



since c(a') = 0. Define now the syndrome vector 

S/ = r(a') 



(4.15) 



= r n + r,a + r 



,(a') 2 + ... + r„_,(a')” 1 



i= 1,2, ..., It 



(4.15a) 



where r 0 , ..., r„_, are the coefficients of r(A') . Thus, 
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(4.16) 



S, = e(a') 

= Co ~f + 62(01 )^ + ... + e '(a ) ' (4.16a) 

In order to simplyfy the notation, assume p errors have occurred where 0 < p < t at lo- 
cations given by A'„ X 2 , .... X p and magnitudes (binary digits) given by Y u Y 2 , ..., Y p . Then 
the syndrome vectors may be written: 

S, = Y x X x +Y 2 X 2 + ...+ YpX p 
S 2 = T,A'f + y 7 x\ + ... + YpXp 



(4.17) 



S 2 , = 1'iA'f + Y 7 X\ l + ... + Y p Xp 

The difficulty in solving this set of equations is due to their non-linearity and non-unique 
solution. By defining intermediate variables and an error locator polynomial, ).{z) given 
by 

j-{z) = ipZ P + j p - \Z P 1 + ... + j.\Z +1 (4.1 8) 

which has zeros at the inverse error locations Xj\ 1=1,2, ..., p. Then, 

/( 2 ) = (1 - zA'0(l - zA' 2 )...(1 - zX p ) (4.19) 

The zeros of this equation lead to the error locations and are equal to the coefficients, 
/.,, /, of/. ( 2 ). The coefficients and syndromes are related by the matrix equation: 
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(4.20) 



Provided that this matrix is nonsingular, and therefore invertible, the above equation can 
be solved. Proof of nonsingularity is found on page 169 in Reference 10. 

Consider for example a (15, 7) double error correcting BCH code in GF(2 4 ) and 
modulo polynomial given by A' 4 + X + 1, so that 

g(AQ = .T 8 + X 1 + X 6 + X 4 + 1 (4.2 1) 

If the message, m(X) = (14- X), then the transmitted vector is 

c(A') = A' 9 + X 6 + X 5 + A 4 + 1 . (4.22) 

The received vector is now assumed to be 

r(A0 = X 9 + X $ + X 6 + X 5 + A 4 + X 3 + 1 (4.23) 



so that 



e(A’) = A rS + X 3 



(4.24) 



Computing the syndromes according to Equation (4.17), 



The determinant, det M = 



5, S 2 



c 8.3 13 

Sj = a 4- a = a 


(4.25a) 


c 16 . 6 11 

= a + a = a 


(4.256) 


e 24 , 9 A 

S 3 = a + a = 0 


(4.25c) 


c 32 . 12 7 

S 4 = a + a = a 


(4. 25d) 


^ 0. Therefore, 
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M = 



(4.26) 
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a 
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Thus, 



M" 1 



0 



4*1 

a 




(4.27) 
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;-i 



[M- 1 ] 



5 3 

5 4 





a 



ill 




(4.28) 



(4.28a) 



/(z) = a U 2 2 + a 13 z + 1 (4.29) 

= (a 8 z 4- l)(a 3 z + 1) (4.29a) 



The error locations occur in the 3rd and Sth positions giving e(X) = A 1 * + X 1, . By in- 
verting the digits in these positions of the received vector, error correction is accom- 
plished. 

Various numerical methods, e.g., Chien search, Berlekamp's iterative scheme, 
and the Peterson-Gorenstein-Zierler algorithm, have been developed to assist in solving 
the error locator polynomial of the BCH codes. Their development and descriptive use 
may be found in References 9, 10 , and 11. 

3. Performance Evaluation 

Error performance of BCH codes are based on maximum likelihood decoding 
principles. Since the weight structure is known only for a small fraction of the family 
of BCH codes, most decoding algorithms are based on having no knowledge of the code 
weight structure. This leads to the probability relationship expressed in Equation (3.9). 
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An upper bound to the decoded bit error probability can be found from 
Equation (3.8) as modified for BCH coding: 

p B £ y ( J -V~ )(jyu - py- j ( 43 °) 

j=t+ 1 

Since the values for t , n and k are known for all values up to n = 1023, Equation 
(4.30) can be evaluated as a function of p. For the case of BCH codes, the co-error 
function is modified to account for code rate, R: 

p=Q {r*%) (431) 

Figure 7 illustrates the upper bound of various BCH codes as derived from 
Equations (4.30) and (4.31). 
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It has been shown in Reference 12 that between code rates of 1/3 < R < 3/4, a broad 
maximum of coding gain versus code rate for fixed values of n occur. Performance de- 
grades significantly for particularly high or low code rates. Figure 7 illustrates per- 
formance of the BC11 codes with R^. 1/2. 

E. REED-SOLOMON CODES 

A very important subclass of nonbinary BCH codes are the Reed-Solomon (R-S) 
codes which achieve the largest possible minimum distance (d mn ) for any linear block 
code with specified block lengths. For nonbinary codes, the distance between code 
words is defined as the number of nonbinary symbols by which the two code words dif- 
fer. The minimum distance for these codes are given by: 

d ma ~"-k+ 1 (4.32) 
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but since n - k = 2 /, 



4n.n = 2r+l (4.33) 

R-S codes use a non-binary alphabet of 2 ra symbols represented by GF(2 m ). How- 
ever, for R-S coding with m = 1, q = 2 m , the symbol field GF(^) and the error locator 
field GF(( 7 m ) are the same (as such, R-S codes are examples of a < 7 *ary BCH codes). For 
m = 1, the < 7 -ary BCH code becomes a /-error correcting R-S code with the following 
parameters: 

Block length: n = q - 1 

Number of parity digits: n - k = 2/ 

Minimum distance: d = 2t + 1 

1. Generator Polynomial 

Using a R-S code with code symbols from the alphabet established by GF(<?) 
where q = 2™, the generator polynomial of a /-error correcting code of length 2 m — 1 is: 

g(A') = (X + a)(X + oc 2 )...(.V + ct 2r ) (4.34) 

where a is a primitve element of GF(^). This is always a polynomial of degree 2/ and 
satisfies the n - k = 2t constraint. 

As for BCH codes, the R-S code vector is obtained by multiplying the generator 
matrix and the message vector to produce: 



c = mG 



(4.35) 



Let 



c(Al = c 0 + c,A' + c 2 X 2 + ... + (4.36) 

be the transmitted vector and 

r(X) = r 0 + r ] X+ r 2 X 2 + ... 4- r n _ : X n ~ l (4.37) 

be the received vector. Then the channel error, e(X), is the difference between the 
transmitted and received vectors and is a symbol from GF(^), 

e = e 0 + e, A' + e 2 X 2 + ... + e^Af” -1 (4.3S) 



or equivalently, 
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eW = r(A') - c(X) 



(4.39) 



If e(X) represents an error pattern of less than or equal to i errors, at positions 
A't, X J 2 , X ! \ then 



e(A') = e h X h + e h X h + .. . + ^X J \ (4.40) 

In order to determine the error vector, the error locations, j h and the error values, e Jr 
must be found. Defining 

P, = ct!' for /= 1,2, ..., V (4.41) 



as the error locations, the value of the error at the location corresponding to /?, is given 
by the following equation [Ref. 9]: 



V 

"1(1 + w’) 



(4.42) 



where 



Z(A] = 1 + (Sj + o,)A'+ {S 2 + o ] S ] + a 2 )X 2 + ... 

+ {S v + (7]S V _] + <7 2-^v 2 "f ••• "f a v)A (4.43) 

where S,. S, S v are the syndrome components S, s. 

2. Decoding of R-S Codes 

In order to decode the R-S code, the procedure is the same as that for any q - ary 
BCH code with the addition of a final step. Final calculation of the error values using 
Equation (4.42) is necessary. The best way to demonstrate R-S decoding is with an ex- 
ample (Ref. 9]. 

Consider a R-S code with symbols from GF(2 4 ) and / = 3. The generator 
polynomial is: 

g(X) = (A' + a)(X + « 2 )(A' + a 3 )(A r + « 4 )(A' + a 5 )(Af + a 6 ) (4.44) 

4 10 , 3 t/2 . 9 t/3 . 9 4. 3 t/5 . / i i i \ 

= ct. -f - <x A + a A + oc A -f ot i *4 -A (4.44t7j 
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Assume that the all-zero vector was transmitted and r, the received vector is given by r 
= (000a'00a 3 00000a 4 00). As such, r(X) = a UP + a 3 A' 6 4- aUP 2 . The syndrome compo- 
nents are generated using Equation (4.17): 



c / 10 , 9 . 12 

S, = r(a) = a + a + a = a 



(4.45a) 



S 2 = r(a 2 ) = a 13 + 1 



(4.456) 



S /3\ . 6 . 10 14 

3 = r(a) = a + a -fa = a 



(4.45c) 




{4.45d) 



(4.45c) 



c „/ 6 \ 10 , 9 , 12 

S 6 = r(a ) = a + a + a = a 



(4.45/) 



Using an iterative algorithm developed by Berlekamp, the error location polynomial 
a (A*) must be found. The description of this algorithm is a lengthy process which may 
be found in References 9 and 13. The following is offered without proof. The error lo- 
cation polynomial o{ X) = 1 + a\V+ a 4 A" 2 + a UP . By substituting 1, a, a 2 , .... a 14 in o(X), 
the roots of a (X) are: a 3 , a 9 and a 12 . These are the error location numbers of the error 
pattern e(X) and the errors occur at positions X 3 , X 6 and X n . 

Now the error values, e , must be computed according to Equation (4.42): 




(4.46) 
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(4.47) 
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(4.48) 
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Thus the final error pattern is: 



1 + a 5 + a 6 + 1 



9 

a 4 
— = a 



e(AQ = aX 3 + a X 6 + a 4 A’ 12 (4.49) 

This corresponds to r(A') — c(A’) so that the final decoded message is found by forming 
r(A') — e(A') and the transmitted all-zero vector is therefore recovered. 

3. Performance Evaluation and Application 

The greatest advantage of the R-S codes is that they achieve the largest possible 
code minimum distance, d min . This distance is given by: 

d mm = n-k+\ (4.50) 



Therefore, R-S coding can correct up to / errors as follows: 

_ ^min \ >2 — k 

2 ~ 2 



(4.51) 



and therefore only requires 2/ parity bits. 

In binary (n. k) coding, the entire w-tuple space is comprised of 2" binary words. 
Similarly, the A-tuple space is made up of 2* binary words. Since R-S codes are nonbi- 
nary, the rt-tuple space is expanded to m?i-tuple where m is the number of bits used to 
represent each symbol. This expands the codeword space to 2 mn , a number significantly 
larger than 2”. This also makes the Aim-tuple space larger but the ratio of kjm decreases. 
The result is that when small fractions of w-tuple space are used for codewords, a code 
with large d mn is created. 

The decoded bit error probability associated with a R-S code follows from the 
results shown in Equation (3.S), with a slight modification. The upper bound to P B is 
given by 






j= f+1 



■p) 



n-J 



(4.52) 



2»>-i 

where the scaling factor — - 
symbol error. 



accounts for the average number of information bits per 
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F. CONVOLUTIONAL CODES 

Previous sections have presented various block codes where the data is grouped in 
A-bit words and coded into /7-bit words where n/k represents the redundancy necessary 
for error detection and correction. Contrasting this technique are convolutional codes 
where the encoder accepts data in groups of A symbols and provides an encoded output 
in groups of n symbols, where n > A. However the encoder output not only depends 
on the current input data but also on previous data blocks; that is, the encoder has 
memory. Convolutional coding is affected by constraint length (number of stages in the 
shift register) and code rate, R = A/m. Significant coding gains and the availibility of 
decoding algorithms which can take advantage of soft receiver decisions, and the relative 
ease with which both the encoder and decoder can be implemented have lead to wide- 
spread use of convolutional codes. 

The most commonly used convolutional codes utilize A = 1. In this case, infor- 
mation bits are shifted into the encoder one bit at a time. As the i' h bit is applied to the 
input of the shift register, all previous bits are sequentially shifted one stage to the right 
and modulo-2 summed as prescribed by the generating polynomial. The output is then 
transmitted while the i’ h + 1 bit is applied to the shift register input and the procedure 
repeated. 

Examination of convolutional coding involves characterization of the encoder and 
decoder. The encoder can be described by one of three approaches, namely: 1) the 
polynomial matrix approach, 2) the scalar matrix approach, and 3) the shift register ap- 
proach. In this discussion, the later will be used. Likewise, decoder characterization can 
also be described through one of three approaches: 1) state-diagram approach, 2) tree 
approach, and 3) trellis approach. 

1. Shift Register Approach 

A (1/2,3) convolutional encoder with generator polynominals (X 2 + X + 1) and 
(A^+l) shown in Figure 6, will be used as an example. Selection of generator 
polynomials is purely arbitrary and is limited only by the number of stages in the shift 
register. Let the message vector m = (I 0 I), the shift register initially loaded with all 
zeros and the output branch word formed as w, u 2 . 

The initial message input generates an output of 1 1 from the modulo-2 adders. 
As the next message bit is applied, the initial bit is shifted one stage to the right and the 
output is now 1 0. This procedure continues until the message vector has passed 
through the shift register and (A' - 1) zeros are input in order to flush the register to its 
initial all zero state. In this example the ouput sequence is: 11 10 00 10 11. 
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Any number of shift registers and modulo-2 adders may be used depending on 
the complexity desired. Generating polynomials will determine the number and location 
of modulo-2 adders. 

2. Trellis Decoding Approach 

The trellis diagram for the (1/2, 3) convolutional encoder is shown in Figure 8. 




Figure 8. Encoder Trellis Diagram: (Rate 1/2, K= 3) 

In order to decode using a trellis diagram, the trellis encoder must first be generated. 
It is formed as follows: from any time state, /, where /' = 1,2, .... 2 K, there are one of two 
transitions that may occur; these represent either a 1 or 0 being applied to the shift reg- 
ister input. By mapping the result of each time period to the next time period, the 
trellis can be completed. The symbols on each of the branches of the trellis are the 
modulo-2 added output as a result of transitions from one time period to the next. For 
instance, referring to Figure 8, at t - 3 in the 1 0 state an input of 0 will result in a 
transition to the 0 1 state at i, along the branch labeled 1 0. The output as a result of 
this transition would be the same as the branch label, 1 0. An input of 1 will result in 
transition to the 1 1 state at r 4 along the branch labeled 0 1. A completed encode trellis 
diagram represents all possible state-time transitions and is fundamental to trellis de- 
coding. 
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The decoding algorithms of trellis codes can be lengthy and complicated proc- 
esses. As such, these will not be explained in this work. References 13 and 14 are re- 
commended for detailed discussions of trellis decoding. The primary objective of trellis 
decoding is to find the singular path through all time states with the least path metric. 
Evaluating the necessary steps to get from t, to k i along the least path metric will result 
in the recovery of the transmitted message with the fewest, possibly zero errors. 

Viterbi's convolutional decoding algorithm [Ref. 15] made use of trellis decoding 
combined with maximum likelihood decisions. This allows the option of soft-decision 
decoding, 4 resulting in recovered message with a lower probability of error. 

3. Performance Evaluation 

Performance evaluation for convolutionally encoded data is not as straightfor- 
ward a procedure as with both BCH and R-S coding. As stated earlier, there are three 
approaches one may take when describing convolutional coding. In describing per- 
formance evaluation, most approaches use a combination of all three descriptive meth- 
ods. In this work, only one approach was used in detailing convolutional codes. 
Therefore, some terms, associated with the other two approaches, must be defined in 
order to continue the derivation of performance equations. Most terms will be intro- 
duced with a minimum of discussion. Reference 15 provides the necessary detailed der- 
ivations. 

The first term that must be defined is the minimum free distance, d [m . This is 
the weight of the minimum- weight path which begins and ends in the zero state (weight 
corresponds to the number of l's in a sequence of binary 7 bits). Its usual derivation 
comes from the state-diagram approach but an analogy to the trellis approach may be 
made. In this respect, d free is the minimum path weight a code may have when diverging 
and remerging to the all-zero path. With this definition in hand, the first event error 
probability may be expressed: 



^ n dP d 




(4.53) 



where n d is the number of codewords with weight d and ? d is event error probability of 
weight d. A probability of bit error may be obtained from this by weighting each term 



4 Soft decision decoding allows for confidence levels when making bit decisions. These levels 
are quantization levels in the demodulator and result in more accurate decisions at the cost of 
demodulator and decoding complexity. 
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by the information weight for each path (i.e., the number of bit errors). However, with 
a code rate of R = kjn, there are k symbols decoded on each branch. So now P B is 
bounded by: 



oo 



X! Wd?d 



(4.54) 



where w d is the total number of non-zero information bits on all d weight paths. 

Now, using the matrix approach, it can be shown from Reference 14 that: 



where p — Q( x ' EJX 0 ) and 

D s redundancy of the code 

X = unicity distance (branch traversed caused by an input of 1) 
T = generating function of a code. 

From 



8T{D, K) 



(4.55) 



8N A’=l, D=7~Jp{\-p) 



OO OO 




(4.56) 



it follows: 




(4.57) 



OO 




(4.57a) 



where 



OO 




(4.58) 
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Now 



OQ 

Pb^-J Y, B “ [ 2 -/>)]" ( 4 -») 

d = df ree 

for a convolutional code with a generating function T(D, N). 

For small values of p, Equation (4.59) is dominated by the first term, so that: 

( 4 . 60 ) 

P~^ ( 4 ' 6 ° 4 ) 



This approximation will be used to evaluate the performance of convolutionally encoded 
data for various codes, and contrasted with the performance of block encoded data. 
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V. CODING FOR THE MFQPSK SIGNAL 

When measuring the benefits of one particular coding scheme versus another, a 
common reference must be established. All other variables being equal, the coding gain 
provided by each coding scheme will be that reference. This is the measure of the de- 
crease in the SNR allowed through coding over an uncoded signal at a specific bit error 
probability. In this evaluation, a bit error probability of 10 _ * will be the fixed evaluation 
level and the performance of various coding schemes measured at that point. The cor- 
responding SNR will be compared to the required SNR of the uncoded received signal 
to achieve the same rate and the corresponding coding gain will be computed. This 
coding gain will be the final performance measurement for the various coding schemes. 
This evaluation assumes that all other variables are equal, even though, in practice, this 
may not be valid assumption. Some codes yield better results in a burst error environ- 
ment while others are tailored more toward correcting random errors. The complexity 
of various codes and their ease of implementation also vary. But these factors cannot 
be measured quantitatively and be objectively weighted in an overall performance eval- 
uation. However, the effects of each of these factors will be discussed so as to at least 
provide a subjective evaluation of each. 

A. BLOCK CODE EVALUATION 

The MFQPSK signaling system can be implemented using various packet combina- 
tions of M tones and A' bauds. A baseline system has been established with M = 64. 
Encoding phase information at each frequency bin will result in 128 binary bits of in- 
formation to be encoded in each baud. 

1. Hamming Codes 

The simplest method for block encoding binary data uses the (7, 4) Hamming 
code. In the case of a baud length of 128 bits, it is obvious that the bauds must be 
subdivided into what will be refered to as Hamming blocks. Each Hamming block will 
contain four bits of information and the requisite three parity bits. In order to use this 
scheme, 32 Hamming blocks are necessary to encode the required 128 information bits 
of each baud. Since each frequency bin contains a di-bit describing a phase, coding in- 
volves effectively two frequency bins per Hamming block. 
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The Hamming block method provides a very good code rate at 4/7 (.5714) but 
is limited by its error single correcting capability. No amount of increased redundancy 
can improve this constraint. 

Another Hamming code that would be useful in the MFQPSK signaling system 
is the (15, 11) Hamming code. This has a code rate of 11/15 (.7333) but maintains the 
single error correcting capability. The (15, 11) Hamming code would be effective for 
block lengths of 16 where the additional bit can be used as a parity check thus enabling 
the (15, 1 1) code to detect the existence of a double error or it can be used as a timing 
or synchronization bit. As shown in Figure 9, the (15, 11) Hamming code provides a 
coding gain of 1.3 dB at a bit error probability of 10~ 5 . 

The use of Hamming codes suggest short block lengths. This is because of the 
Hamming codes' limit of t = 1 error correcting capability. If this limit were applied to 
the entire baud, then the baud would have an error correcting capability equal to ex- 
actly the number of blocks of 16 coded bits. But the errors would have to occur at a rate 
of no more than one error per block coded bits for the Hamming code to be successful. 
For this reason, Hamming codes are not useful in environments where burst errors are 
dominant. 
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2. BCH Codes 

Lin and Costello [Ref. 13, Appendix C] have documented BCH codes up to 
length 2 10 - I, showing various combinations of block lengths and information bits along 
with their respective generating polynomials. While creating an inordinately large block 
length, like (1023, 11)/= 255, in order to take advantage of the large error correcting 
capability, the added block length increases the transmission bandwidth and the de- 
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creases code rate (.01 1 in this example). This is unacceptable for the application of in- 
terest here. To combat this, it is desired to have the block length long enough to encode 
the data with a code that has an acceptable error correcting capability. In the example 
of transmitting 64 frequencies (128 information bits) two approaches may be taken, 
a. A (127, 64) BCH Code 

To maintain a baud-to-block length continuity, a (127, 64) with t = 10 
BCH code can be used. In this case, each baud that is transmitted contains 64 infor- 
mation bits as well as the 63 parity bits in order to generate a block of 127 coded bits. 
A block parity bit may be added to increase block length to 128 elements. Computer 
programs used to evaluate the performance of various schemes utilizing BCH codes (see 
Appendix A) have shown that the effect of the added parity bit is negligible. That is, the 
SNR at any bit error probability is decreased by less than .1 dB. At a bit error proba- 
bility of 10’ 5 , the coding gain achieved for the (127, 64) BCH code is 2.8 dB. This result 
is shown in Figure 10. 
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b. A (255, 139) BCH Code 

In order to include all 128 information bits of one baud in a single block, 
a (255, 139) with t = 15 BCH may be used. This will maintain baud continuity in that 
all the 128 information bits are encoded in the same block. The (255, 139) code allows 
for 139 information bits, 11 more than that contained in the individual baud. What to 
do with the extra information positions can be the subject of further research. Possibil- 
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ities include using the 1 1 extra information positions as synchronization data bits. In 
this manner, the signal will be synchronized every baud and eliminates the necessity of 
a synchronization tone or preamble. Perhaps cryptographic keying information may be 
contained in the 1 1 extra positions. Again the addition of an overall parity bit, like the 
previous (127, 64) BCH code is necessary. Figure 11 shows the information/parity bit 
relationship of the modified (255, 139) BCH code. 



128 information bits 



11 

synch 

bits 



overall 
parity bit^> 



116 

parity bits 



T 



256 Total Bits 



Figure 11. Bit Stream for a Modified (255,139) BCH Code 

Figure 10 shows that at a bit error probability of 10' 5 , the coding gain of the 
(255, 139) BCH code is 3.8 dB. This is a substantial decrease in SNR at a given bit error 
probability and clearly illustrates the advantages of error correcting codes. It should 
also be added that increased redundancy does not always mean improvements in error 
performance and, hence, coding gain. Performance degrades substantially at very high 
and very low data rates. For medium code rate block codes (1/3 to 1/4), a broad range 
of coding gains occur and are subject to increased redundancy. Outside this region, re- 
dundancy does little to increase coding gains. 

BCH codes, because they are a generalized version of Hamming codes, are 
more effective as random error correcting codes and have limited use in a burst error 
environment. However, BCH codes do offer the advantage of variable block lengths and 
improved performance with low implementational complexity. 
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3. Reed-Solomon Codes 

Reed-Solomon codes offer significant error correcting capabilities. This is be- 
cause they have the largest possible code minimum distance of any block code of the 
same length. Minimum distance equals n — k+ 1 and the /-error correcting capability 
is: 



Because of their large error correcting capability and corresponding moderate code rates, 
these codes tend to offer great coding gains. Continuing example in which processing 
128 binary information bits is required, two particular R-S are considered. 
a. A (127, 65) R-S Code 

Using arguments similar to those used previously in the discussion of the 
(127, 64) BCH code, the (127, 65) with / = 31 R-S code can maintain the baud-to-block 
length continuity. However, an information sequence parity check bit is needed for the 
code's completion. An additional overall parity check bit will result in a block length 
of 2' where / is an integer. The error performance associated with this code is illustrated 
in Figure 12. At a bit error probability of 1 0 -5 , the (127, 65) R-S code has a coding gain 



b. A (255, 133) R-S Code 

The (255. 133) with / = 61 R-S code offers large error correcting capability 
and coding gains. In the application of processing 128 information bits, information bit 
continuity is maintained per block. That is, all 128 information bits are contained in one 
encoded block. But again, like its BCH counterpart, signal bandwidth is doubled be- 
cause the encoded block is approximately twice as long as the information bits contained 
in the baud. The extra information bits available in the block code (five in this case) and 
the addition of an overall parity check bit occur here in a manner similar to that en- 
countered for BCH codes. 



errors that occur in short bursts where the bursts approximately match the symbol size, 
m, in a 2” length code. Conversely, R-S codes do not perform as well as BCH codes in 
a random error environment. 




n — k 
2 



of 7.5 dB. 



The greatest advantage of Reed-Solomon coding is the ability to correct 
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Figure 12. Bit Error Probabilities for Reed-Solomon Codes 

B. CONVOLUTIONAL CODE EVALUATION 

From Equation (4.60a) the variables involved in specifying the performance of a 
convolutional code are primarily influenced by the values of d /rM . This factor, in turn, is 
a parameter of the constraint length of a code, K. It is desirable, in terms of perform- 
ance levels, to use the largest value of K without unnecessarily complicating the 
encoder/decoder structure. Odenwalder investigated a code's constraint length versus 
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coding complexity and documented the results in Ref. 16. A convolutional code of 
constraint length, K = 7, using a Viterbi decoding algorithm was found to yield the best 
overall performance characteristics. Therfore only convolutional codes with K = 1 and 
Viterbi decoding will be considered here. An additional condition that must be estab- 
lished prior to the code's evaluation is the code rate. While evaluating possible block 
codes in the previous section, code rates very near 1/2 were considered. In order to 
preserve a consistent evaluation, convolutional codes with R = 1/2 will be evaluated. 
Code rates of less than 1/2 will provide better decoded bit error rate performance but this 
improved performance will come at the cost of bandwidth and receiver complexity. 

With the above conditions (K = 7, R = 1/2), convolutional codes can be considered 
for which the free distance, d /ree is a fixed value of 10. At d /r „ = 10, B dfrct = 36. (These 
values are tabulated for various values of d free on page 625 of Reference 15.) A computer 
program (see Appendix B) was used to evaluate various convolutional codes based on 
combinations of d free and B dtf . The results are illustrated in Figure 13. The coding gain 
achieved can be measured from Figure 13 as 3.2 dB for d /r „ = 10. Increasing d fr „ to 12 
generates a B d of 211 and a coding gain of 3.9 dB. The free distance can be increased 
as the Hamming distance between two codewords is increased. However, this will result 
in a different value for B d . as tabulated in Reference 15. 

To complete the examples presented Figure 13, a K = 5, R = 1/2 convolutional 
code is included. In this case, d f ,„ = 7 and B d — 4. This example is included because 
a A'= 5. R = 1/2 code is available in a single integrated circuit and would be simple to 
implement. Using the convolutional code incorporated in this integrated circuit, a cod- 
ing gain of 2.5 dB will be achieved. 

Convolutional codes in general respond very well in a burst error environment. 
Specific classes of convolutional codes have been developed to further improve the burst 
errors correcting capabilities. The Berlekamp-Preparata code and the Iwadare-\lassev 
code are two of these codes and are discussed on pages 430 - 440 of Reference 14. 
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VI. CONCLUSIONS 



A. THE MFQPSK SIGNALING SYSTEM 

This study has presented the fundamental principles of a multi-frequency modu- 
lation (MFM) scheme. The major factor for considering this scheme is the potential use 
of this modulation technique in a variety of media. More specifically, the MFM scheme 
was directed towards a Multiple Frequency Quaternary Phase Shift Keyed (MFQPSK) 
signaling system in an underwater acoustic signaling application. The MFQPSK sig- 
naling system was first presented, and then followed by the establishment that error 
detection correction (EDC) is a desireable feature for insuring fidelity of the received 
signal. However with the many EDC coding schemes available, a determination of those 
best suited for the signaling system under consideration had to be made. Decoded bit 
error rate performance using various block and convolutional codes were evaluated and 
a computer program generated to calculate and plot these bit error probabilities as a 
function of SNR. After considering specific coding schemes (such as Hamming, Golay, 
BCH, R-S. and convolutional codes), a determination was made as to how each of the 
selected coding schemes could be used in conjunction with the MFQPSK signaling sys- 
tem. 

The performance of each of the many block codes and convolutional codes vary 
when subjected to different channel environments. In an environment in which random 
errors most often occur, Hamming, Golay, and BCH codes outperform R-S and 
convolutional codes as a whole. This is a broad generalization, but one which can be 
substantiated by evaluating error performance associated with each of the codes. It is 
evident that if the channel environment can be successfully predicted (determination of 
burst versus random error conditions), then the EDC coding selection would be simpli- 
fied. However, the channel environment cannot be accurately predicted. Furthermore, 
the channel medium must be characterized and modeled accurately. However the degree 
of complexity of this effort is such that a separate project is being carried out, concur- 
rently with this study, that involves modeling an underwater acoustic channel as the 
medium for propogation of the MFQPSK signal. Until such time as experimental results 
can verify the channel model being developed, all results are subject to the validity of the 
assumptions in the model. 
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When using block codes for EDC in the MFQPSK system, selection of baud length 
to be transmitted will affect the selection of a block code to be used. Hamming codes 
provide adequate coding gains when used as a short block code in a random error envi- 
ronment, but are limited by their error correcting capability. BCH codes yield good 
coding gains at the specified value of bit error probability used in this project. BCH 
codes offer a wide selection of block lengths and error correcting capabilities, with good 
responcs when used in environments where random errors dominate. R-S codes provide 
substantial coding gains, however at a price that R-S codes being ^-ary codes, block 
lengths are large (a R-S code where q = 2 is the same as a binary BCH code). These 
large block lengths add complexity to the encoder and decoder structures. 

A class of codes that perform well in environments where either type of error, ran- 
dom or burst, occur are the group of convolutional codes. Since convolutional code's 
performance is dependent on the number of stages in the shift register used to generate 
the code, their implementation tends to be less complex than that of block codes. The 
number of stages in the shift register, called the constraint length, affects two parame- 
ters, namely (d /rer and ) which are used in the evaluation of bit error rate performance 
of convolutionally encoded data. Once a constraint length is established, these two pa- 
rameters can be determined and performance evaluated. An advantage of applying 
convolutional codes to the MFQPSK signal system is the inherent ability to process the 
bit stream continuously. As bauds become filled with information (binary data), they 
can be processed through the convolutional encoder while other bauds are filled with 
more information. 

In conclusion, convolutional codes were found to provide adequate values of bit 
error probabilities over a wide range of SNR's and significant coding gains. Addi- 
tionally, they are relatively easy to implement and are well suited to the MFQPSK sig- 
naling system and its signal structure. 

B. AREAS OF CONTINUED RESEARCH 

The EDC codes studied in this project were developed singularly. Coding schemes 
used in existing communication systems use a combination of these individual codes. 
Such codes are referred to as concatenated or interleaved codes. Concatenation is a 
method of constructing long codes from shorter codes. Concatenated coding can be 
explained by the following: encode an information bit stream initially using a R-S code 
and then process the resulting encoded bit stream through a convolutional encoder. This 
double coding results in concatenation. Coding gains provided by concatenated codes 
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and their application to the MFQPSK signaling system present research areas which 
have as yet not been addressed. Additionally, as channel models are further refined, 
various EDC coding schemes that incorporate these channel models can be further re- 
fined, analyzed, and verified by experimental results. 
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APPENDIX A. BCH AND R-S CODING PERFORMANCE EVALUATION 



The purpose of this computer program is to evaluate and plot BCH and R-S coding 
performance curves on the IBM mainframe computer at the Naval Postgraduate School 
with calls to the IMSL10 library. The output graph will be a semi-logarithmic scale of 
Bit Error Probability vs. SNR. The input data will consist of the code's description. 
For example, if a (127, 64) t = 10 BCH code were to be evaluated, the inputs would be 
K = 64.0, n = 127, and t = 10. It is imperative that the values are used as described in the 
initial declarations. Specifically, n and i must be integers. This permits successful calls 
to subroutines and functions external to this program. The equations this program is 
designed to calculate are given by Equations (4.30) and (4.31) for BCH codes, and by 
Equation (4.52) for R-S codes. 

Flexibility is built into this program so that R-S codes may also be computed using 

this program. Program lines which need modification depending on which code is being 

computed are noted with an asterisk (*)• 

C 

C 

C 

C VARIABLE DECLARATIONS 
C 

REAL BC, JJ, TT, NN, Z, SF 

REAL R, SNR, XPLT(2000), YPLT(2000), S, TWO, K 
DOUBLE PRECISION X, Q, PI, P2 
DOUBLE PRECISION PROB , TEMPI, TEMP2 
INTEGER II, J, T, N, TP1 
C 
C 

C VARIABLE INPUTS 

C 

K = 64. 0 
N = 127 
T = 10 
C * M = 7 

C This is needed to generate the scaling factor for R-S codes and 
C is different for each code. M=7 is an example only. 

C 

C INITIALIZATION 

C 

II = 0 
R = K/N 
J = T + 1 
TP1 = J 
TWO = 2 
S = SQRT(TWO) 

C * SF = (2 ** (M - 1) )/( (2 ** M) -1) 
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oooo oooooooo oooooooooo 



This is the scaling factor for R-S codes. 

PROGRAM COMPUTATION. This starts the loop. For each value 
of Z, a Q(.) is calculated and later used in computing 
probability. The DERFC is a double precision intrinsic 
function describing the co-error function as defined in 
Equation (3.2). The BINOM is another intrinsic function 
which computes the binomial coefficient of N and J for 
each iteration of J. R represents the code rate, K/N. 

DO 100, Z = 1, 40, 1 
X = SQRT( 2 * R * Z) 

Q = .5 * DERFC(X/S) 

SNR = 10 * AL0G10(Z) 

PROB = 0. 0 
DO 80, J = TP1 , N 
BC = BIN0M(N, J) 

NN = N 
JJ = J 
TT = T 

PI = ((JJ + TT) /NN) 

P2 = ((1 - Q) ** NN) 

TEMPI = PI * BC * P2 

TEMP2 = (Q/( 1-Q)) ** (jj/ioo.0) 

DO 20, K = 1, 100 

IF (TEMPI . GE. IE -75) THEN 

This IF statement was necessary to prevent 
underflow problems on the IBM mainframe. 

Any value less than IE-75 was considered 
equal to zero. While this is recognized as 
undesirable, it was necessary to continue with 
the program. 

TEMPI = TEMPI * TEMP2 
ELSE 

TEMPI = 0. 0 
END IF 

20 CONTINUE 

* IF ECH THEN 

PROB = PROB + TEMPI 

* ELSE, R-S 

* RS = SF * PROB 

WRITE (81,200) SNR, PROB 
80 CONTINUE 

II = II + 1 
XPLT(II) = SNR 
YPLT(II) = PROB 



100 CONTINUE 
C 
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200 FORMAT(2X, F7.4, 2X, D12. 7,/) 



PLOTTING. This plotting routine is unique to the DISSPLA graphics 
program, version 9.0. Explanations and applications are best 
addressed by the reference manual and will not be individually 
considered. 

CALL COMPRS 
CALL PAGE( 11,8.5) 

CALL NOBRDR 
CALL AREA2D( 6,8) 

CALL XNAME( ' SNR $' ,100) 

CALL YNAME(' BIT ERROR PROBABILITY $' 100) 

CALL HEADINC BCH CODED PROBABILITY $‘,100,4,1) 

CALL GRACE( 0. 0) 

CALL YL0G(4. 0, 1. 5,0. 0000000001,1. 0) 

CALL SETCLR( 'MAGENTA' ) 

CALL CUR VE(XPLT,YPLT, 10,0) 

CALL ENDGR(l) 

CALL ENDPL(l) 

CALL DONEPL 

STOP 

END 
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APPENDIX B. CONVOLUTIONAL CODING PERFORMANCE 

EVALUATION 



The purpose of this algorithm is to compute and plot convolutional coding per- 
formance curves. Equation (4.60a) defines the equation used in this program. As in 
Appendix A. the semi-logarithmic axes will be Bit Error Probability and SNR. 

Variables are defined as follows: 






and 



DF^dfree 



and K=> constraint length of the code. 

C 

C 

C VARIABLE DECLARATIONS 

C 

REAL DF, BDF , K, S, SNR, XPLT(500), YPLT(500), T, Z 
DOUBLE PRECISION X, Q, PROB 
INTEGER II 
C 
C 

C VARIABLE INPUTS 

C 

DF = 7. 0 
BDF = 4.0 
K = 7. 0 
C 
C 

C INITIALIZATION 

C 

D2 = DF/2 
T = 2. 0 
S = SQRT(T) 

II = 0 
C 
C 

C PROGRAM COMPUTATION. For each value of Z, a Q(.) is determined. 
C DERFC is a double precision intrinsic function describing the 

C co-error function as defined in Equation (3. 2). 

C 

DO 100, Z = 1, 20, 1 
X = SQRT(Z) 

Q = . 5 * DERFC(X/S) 

SNR = 10 * AL0G10(Z) 
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P = ( l/K) * BDF * (2 ** DF) * (Q ** D2) 

C 

WRITE (9, 200) SNR, PROB 
II = II + 1 
XPLT(II) = SNR 
YPLT(II) = PROB 
100 CONTINUE 
C 

200 FORMAT (2X, F7.4, 2X, D12.7,/) 

PLOTTING. This plotting routine is unique to the DISSPLA graphics 
program, version 9.0. Explanations and applications are best 
addressed by the reference manual and will not be individually 
considered. 

CALL C0MPRS 
CALL PAGE( 11,8. 5) 

CALL N0BRDR 
CALL AREA2D( 6,8) 

CALL XNAMEC ' SNR $' ,100) 

CALL YNAME( ' PROBABILITY $', 100) 

CALL HEADIN( 'CONVOLUTIONAL CODE PERFORMANCE $’,100,4,1) 

CALL GRACE (0.0) 

CALL YL0G(3. 0,1. 5,0. 000000001,1. 0) 

CALL SETCLR( 'MAGENTA' ) 

CALL CURVE (XPLT,YPLT, 20,0) 

CALL ENDGR(l) 

CALL ENDPL(l) 

CALL DONEPL 
C 

STOP 

END 
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